EXTENSION TO INFINITE DIMENSIONS OF A STOCHASTIC SECOND-ORDER 
MODEL ASSOCIATED WITH THE SHAPE SPLINES 
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Abstract. We introduce a second-order stochastic model to explore the variability in growth of biological 
shapes with applications to medical imaging. Our model is a perturbation with a random force of the 
Hamiltonian formulation of the geodesies. Starting with the finite-dimensional case of landmarks, we 
prove that the random solutions do not blow up in finite time. We then prove the consistency of the 
model by demonstrating a strong convergence result from the finite-dimensional approximations to the 
infinite-dimensional setting of shapes. To this end we introduce a suitable Hilbert space close to a Besov 
space that leads to our result being valid in any dimension of the ambient space and for a wide range of 
shapes. 
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1. Introduction 

A new problem has emerged very recently in computational anatomy: the mathematical modeling and 
^ \ the statistical study of biological shape changes. Medical applications are of great interest such as the early 
^ ' detection of disease: for instance, Alzheimer's disease induces hyppocampal atrophy. Current approaches 
study the shape evolution through indicators (such as the volume or the length of characteristic patterns) 
or through the parameters of objects with simple geometries (such as ellipsoids) used to describe the more 
complex biological shape of interest. Therefore there is still room for a more quantitative analysis of the 
variability of longitudinal data. 

Although the analysis of shape evolution is quite a new question, the analysis of the variability of static 
shapes has motivated tremendous research in recent years with broad applications in medical imaging. 
Most of the efforts has been on developing tools to compare two static shapes. This problem is also 
refered to as the registration problem. Numerous attempts to answer this problem introduce a metric 
on the space of shape |20l I21| and the geodesic flow |22| on this space provides a powerful framework to 
statistically study the variability of biological organs among a population |30| . Hence it seems reasonable 
to build out of this framework proper tools to analyse the growth of shapes. 

Our work contributes to the field of large deformation by diffeomorphisms that emerged twenty years ago 
with the idea of studying shapes under the action of a group of transformations of the ambient space |15j . 
Thus the distance on the space of shapes is induced by the distance on a group of diffeomorphisms through 
its action on shapes |27] . This framework has been widely applied to computational anatomy in the recent 
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years [32^ [5] and important contributions have been made even on numerical issues [8]. Different ways of 
representing shapes have been introduced to fit in this framework, such as points of interest (also refered 
to as landmarks) , measures or currents for surfaces |13] . The application of the theory to images is also 
important since it can avoid pre-segmentation operations that erase information. The approach of large 
deformation by diffeomorphisms has therefore proven to be adaptable and powerful. 

In attempting to describe the growth of biological organs, non-diffeomorphic evolutions should be taken 
into account at some point. The so-called metamorphoses framework |28[I17| can deal with such evolutions. 
However we will focus on the diffeomorphic case which is the first step to be understood. 

The initial registration problem on images aims at minimizing a functional (see formula ([T|)) which is 
the sum of two terms: the first being the cost of the transformation and the second being a similarity 
measure between the transformed shape tfii.So and the target Star get- 



In this equation, ut £ L 2 ([0, 1],V) is a time-dependent vector field where V is a reproducing kernel 
Hilbert space of vector fields and d is a distance on the space of shapes. The group of diffeomorphisms is 
generated by the flow at time 1 of such time dependent vector fields and an action of this group on the 
space of shapes. We have denoted the action of <j)\ on Sq by 4>\.Sq. If there then exists a minimum to 
this functional, this minimum will provide a balance between a good matching of the target shape and 
the cost of the transformation. 

The first term on the right-hand side in (pQ) should reflect the likelihood of the deformation <p\ . Therefore 
this matching procedure is motivated by a Bayesian approach as presented in |12| : the starting point is to 
interpret the minimization of the functional (p} as a maximum a posteriori. Although in |12| no rigorous 
results were established to make the connection between the MAP interpretation and the minimisation 
problem, a rigorous asymptotic theory of the problem was developed recently in [7j- The author prove 
a large deviation principle for which the rate is the first term of (JT|). The probabilistic foundations for 
their work are given by the study of stochastic flows of diffeomorphisms developed in |18| and the random 
object associated with the prior on the diffeomorphism in ([!]) is the stochastic flow defined by, 



In these equations (Sj)j g ^ are i.i.d Brownian motions, (ej)j£N is an orthonormal basis of V and the 
symbol o stands for the Stratonovich integral. If the space of vector fields is smooth enough (regularity 
assumptions on the kernel), the proof of the existence of the stochastic flow can be found in Theorem 4.6.5 
of |18| . Through the action of the random diffeomorphisms, this approach gives evolutions of the shape 
that are non- smooth in time due to the Brownian motions. However, at each time the transformation is 
smooth in space as we can see in figures Fig.[T]and Fig. [2] In these two figures, we present the time evolution 
(z-axis) of 40 points on the unit circle under the transformation of a Kunita flow of diffeomorphisms for 
a Gaussian kernel of width 0.9. 
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FIGURE 1. Simulation of Kunita 
flow - 40 points on the white unit cir- 
cle as initial shape. 



FIGURE 2 . Simulation of Kunita flow - the 
time axis is z, the blue arrow. 
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We would definitely prefer a probabilistic framework for smooth evolutions of shapes that we think 
are closer to biological growth evolutions (note that this hypothesis is heuristic). In addition, the large 
deviation result in [7] does not lead to a generative model for diffeomorphic evolutions in this context. 
One important property of the model would be the smoothness (i.e. not as rough as a standard path of 
the Brownian motion) of trajectories. 

To build a second-order model coherent with the framework developed for diffeomorphic matching is a 
natural way to overcome this issue. 

Let us discuss the finite-dimensional case of particles. In the landmark case, the minimization of ([TJ 
reduces to the calculation of the geodesic flow on a Riemannian manifold. The Hamiltonian formulation 
of this geodesic flow is often used in practical applications [3] and seems appealing as well to build 
this second-order model. To describe time dependent evolutions we can introduce a control term in the 
equation of the momentum that would guide the trajectory to match the evolution. Minimizing an energy 
term on the control variable would lead to a generalized version of the splines on a Riemannian manifold 
pioneered in |23j . We have recently studied this model that we called splines on shape spaces in |29] 
focusing on the finite-dimensional case. The new evolution equations on the Riemannian manifold M of 
landmarks (i.e. q G M stands for a group of points) are then 



where g is a metric that measures the cost of the forcing term ut 6 T*M. The random object associated 
with this model is obtained by replacing m with a standard white noise. Hence it can give a reasonable 
stochastic model to generate C 1 trajectories in M. This stochastic model seems promising to study since 
we expect to keep the numerical tractability allowed by the Hamiltonian formulation. 
However the main interesting feature concerning the modeling aspect of our work is the physical inter- 
pretation of these equations. If we consider the evolution of landmarks as a physical system of particles, 
it seems natural to introduce a random force to their evolution: an additive white noise is added to 
the evolution equation of the momentum. This idea of perturbing the evolution equations with a ran- 
dom force has been introduced for a long time in the stochastic fluid dynamics community ([6]). Our 
stochastic system is a stochastic perturbation of Euler-Poincare equation coding for the geodesies on a 
group of diffeomorphisms (also refered to as EPDiff equation, [9]). From this point of view, this work 
may have some relations with the study of stochastic perturbations of the vortex model ([4] and [2] for 
a brief survey). We do not develop these links in this work but instead we will focus on this model of 
growth of shape. However, to turn this model into a tractable candidate to deal with a collection of shape 
evolutions at different times and to perform statistical studies on real data, we would need to introduce a 
drift term (i.e. a deterministic forcing term) in the momentum equation. Finally, if the stochastic model 
is well-posed when there is no forcing term, it will not be difficult to extend it. 
By well-posed, we mean it possesses the following two features: 

• the existence for all time of the solutions of the stochastic equations (since the Hamiltonian system 
does not have linear growth), 

• the extension of the model to infinite dimensions (on shape spaces) and associated convergence 



In this work, we answer both questions in the affirmative and the strategies followed are the classical ones: 
for the non-blow-up result, the application of the Ito formula gives a linear control on the expectation of 
the energy of the system measured by the Hamiltonian. The extension to infinite dimensions relies on 
the construction of a new Hilbert space that is close to Besov space. This Hilbert space is much more 
tractable than the classical Sobolev or Besov spaces and it suits perfectly our convergence result that is 
somehow disconnected from the chosen Hilbert space for the approximation. 

The paper is organized as follows: after an introduction to the deterministic case in Section [2] in which 
we present the convergence to the infinite-dimensional case of curves, we prove in Section [3] that the SDE 
in the finite-dimensional case of landmarks has solutions for all time. In Subsection I3.1[ we prove the 
property that the shape space should fulfill in order that the SDE in infinite dimensions is well defined. 



(3) 




and we aim at minimizing 



(4) 




results. 
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To give an example of such a space, we introduce in Section [5] a new Hilbert space F s which has interesting 
properties of stability under composition with smooth functions, product stability and which also contains 
smooth functions. 

We define the cylindrical Brownian motion in Section 15.11 and the Ito integral in a useful way for the 
convergence results developed in Section [6J These results rely on approximation lemmas detailed in 
Section [7] that are somehow disconnected from the finite-dimensional approximations. Section [8] draws on 
the previous sections to illustrate applications of this convergence results. We also show some numerical 
simulations. Finally Section [9] tries to open research directions around this stochastic second-order model 
essentially motivated by applications. 

2. Overview of the deterministic case 

2.1. Optimal control heuristic. In this section we present an optimal control heuristic to derive the 
Hamiltonian equations that can be formally applied in the finite or infinite-dimensional case. These results 
are proven in |31| for the case of landmarks and in |14| in the case of curves. 

Let G be the group of diffeomorphisms of R d (d is the dimension of the ambient space) generated by 
the flows of time dependent vector fields in L 2 ([0, 1], V) where V is a Reproducing Kernel Hilbert Space 
(RKHS) of C 1 vector fields on M, d with the additional hypothesis: 

Assumption 1. There exists a continuous injection of the Hilbert space V of vector fields into C , i.e. 
there exists a positive constant K such that Hi j0 o < ^|i>|y for any v & V . 

We also say that V is 1— admissible. It is more demanding than the RKHS condition, namely that the 
pointwise evaluation is a continuous form on V. In what follows, k : R d x M. d — > L(T*M d ) will denote the 
kernel of the RKHS. 

Then the minimization problem ([TJ can be recast into an optimal control problem: if the space of shapes 
is a Banach space E endowed with an action of the group G that we assume to be differentiable in the 
following sense: There exists a linear map 

V x E t-> E 
(v, q) i — y v.q 

such that for any v G L 2 ([0, 1], V) we have 

-Tj;[<f>o,t-q] = v t .[4> ,t-q]a.e., 

00,1-9 = 9+ / v t .[4>o,t-q] dtvt g [0, l]. 
J o 

The existence of a minimizer for the functional ([1]) in situations of interest is usually proven via standard 
arguments of lower semi-continuity for the weak topology on L 2 ([0, 1], V). Let us assume that there exists 
a minimizer vq for the functional (fT]), then it also minimizes the energy ^ \ vt\ydt with fixed endpoint 
00 l-9o = 0o°l-9o- The optimal control theory enables us to be a little more general by assuming that we 
are interested in the solutions of the minimization of: 

9(0) G M 
9(1) G Mi 

with Mo, Mi two subsets of Q with tangent spaces at a point q\ G Mj denoted by T qi Mi for i = 0,1. The 
case of Mq and Mi can be found in the case of curves considered up to reparameterization as demonstrated 
in |10j : the two subsets Mj for i G {0, 1} are generated by the action of the group of diffeomorphisms of Si 
and the functional ([1]) may be invariant for this action. In that case, the Pontryagin Maximum Principle 
(PMP, (TJ [26]) provides orthogonality relations for the momentum. With E* the dual of E, the control 
on q G E is v G V with an instantaneous cost function ^\v\ v and we have q = v.q. Then, the Hamiltonian 
system associated with this minimization problem is 



(5) 



(6) 



H(p,q,v) = {p,v.q) E *,E ~ ^(v,v) v 
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Before minimizing in v, we need to assume that 

v H> (p,v.q) E *,E 

is a continuous linear form on V for any p,q £ E* X E (hypothesis (HI)). 

For example in the case of landmarks the hypothesis (HI) just says that the pointwise evaluation on V is 
continuous, i.e. V is a RKHS of vector fields. Then, by the Riesz theorem there exists poq 6 V* defined 
by the equation: 

{p,v.q) E *,E = -{poq,v)v*,v ■ 

This notation is taken from |17| and it is also known as the momentum map in geometric mechanics. 

The second term of equation © can be rewritten as (Lv,v)y*xV- Then, at a minimum we can 
differentiate in v to obtain 

Lv + p q = 

or equivalent ly, v + K(po q) = 0. 

Therefore the 'minimized' Hamiltonian is, 

(7) H(p,q) = (poq,Kpoq) v *y - -(v,v) v = -(po q, Kpo q) v *,v ■ 

The Pontryagin maximum principle says that a minimizer of the problem ([5]) verifies the following Hamil- 
tonian system 

p = -d q H(p, q) 
q = d p H{jp, q) , 
with orthogonality conditions 

P(0) -L T q{0) , 
P(l) J- T q{1) . 

At this point, we need to give a sense to d q H(p, q) in ([8]). Assuming that q i— )■ (p, v.g) is differentiable for 
every q £ E, we write <5g i— >• d q (p,v.q)(5q). In addition, we assume that d q (p,v.q)(5q) is a linear form on 
V (hypothesis (H2)) that we denote 

d q (p,v.q)(5q) = ~(d q (p o q){5q),v) v * xV . 

The differentiation of H (p, q) reads, 

d q H(p,q) = (d q (pOq),K(poq)) . 

In the landmark case, the second hypothesis (H2) says that the pointwise evaluation for the first derivative 
of the vector fields is continuous on V . In particular, if V is 1— admissible, this condition is fulfilled. 

We now present the case of landmarks that will be the cornerstone of this work. The Hamiltonian 
system reads, if q = (<2i)ign n i are the particles in M. d and p = ijpi)i^n n } are the associated momentums 

^ \ Pi = ~ E"=i d iK^ Qj)(Pi,Pj)Rd , 

This is the Hamiltonian system that will be perturbed in Section [3j 

Let us discuss the case of curves following the point of view adopted in |14| . We consider generalized 
closed curves, which means that we will work on Q = L 2 (Si,M. 2 ). Of course, this framework can be 
extended to Q = L 2 (M,M. d , //) with M a compact Riemannian manifold and fi its associated measure, 
for instance M = S n the n-dimensional sphere or M = T n the n- dimensional torus. The action by Gy 
is simply the left composition on Q. The map on V x Q induced by the action of Gy is also the left 
composition with v G V: (v, q) t— > v o q and the hypothesis (HI) is verified if V is an admissible space of 
vector fields since: 

(v(q(s)),p(s))d(i(s) < \p\ L 2\v o q\ L 2 < \p\ L 2\v\ VMM). 

The second hypothesis (H2) is verified in this case too replacing v by dv. Remark that [d q v o q].Sq = 
[dvoq](5q) e L 2 (M,R d ,fi). 

The transversality conditions are interesting in the case of curves considered up to reparameterization. If 
the initial curve cq and the final one c\ are smooth enough, the action of the diffeomorphism group of S\ 
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generates a large subspace of tangent vectors at Cj for i = 0, 1: let w be a smooth vector field on S\, if ipt 
is the flow generated by w, we have -^: t _ Q (f>t(x) = w(x) then, 

{ s ^ uj(a)^(a) | to G X°°(Si)} C T Ci . 

The orthogonality condition says that pi _L T Ci and considering all the choices for w (any smooth vector 
field on Si) we obtain that 

(pi(s),c-(s)) = a.e.s G Si . 

2.2. Convergence to the infinite-dimensional case. We develop a consequence of the Hamiltonian 
formulation of the equations originally written in |14| . not written in this article. This paper presents a 
rigorous proof of the existence in all time of the solutions to the Hamiltonian equations when the space 
of closed curves is the Hilbert space H = L 2 (5i,R 2 ) and the momentum variable lies in the dual space 
of H, identified to H. The structure of the momentum variable is determined by the differentiation of 
the attachment term in ([1]) and the situation p G H arises for a large class of attachment term. The 
Hamiltonian system 

(9a) d q H(p t ,q t ) = -pt(-) <9i%t(-) , q t (s))p t (s)ds , 

J Si 

(9b) d p H(pt,q t )= k(q t (.),q t (s))p t (s)ds , 

J Si 

has solutions for all time for any initial conditions (po,qo) G H 2 . 
A simple though important remark is 

Remark 1. The ODE ([9]) conserves the common structure of p and q: i.e. if p and q are both constant 
(in space) on an interval (resp. a measurable set on S\) then the solution (p,q) will be constant on this 
interval (resp. on this measurable set). 

The consequence of this remark is that the landmark case is a special case of the ODE ([9]) . Consider the 
n-dimensional subspace of H for n > 1, H n = Spanj g r re _i| (li± i+ir), then H n is one candidate to describe 
the trajectories of n landmarks, taking initial conditions (po,qo) G H n x H n . It gives also a convergence 
property by the continuity of solutions of a Lipschitz ODE system. With stronger assumptions on the 
convergence of q n but still the same assumption on the convergence for p n , we obtain strong convergence 
of q n . 

Proposition 1. Let (pqj^o) ^ H n x H n be initial conditions for the system ([9|) with limn^oo (j?q > Qo ) = 
(j),q) then, the solutions (p",?") converge in H x H to (pt,qt) uniformly for t in a compact set. If we 
assume in addition that hnin^oo \\q n — q\\oo = then linin^oo \\q™ — qt ||oo = uniformly for t in a compact 
set. 

Proof. The first point is the direct application of the continuity theorem for the Banach fixed point 
theorem with parameter. The second point is a consequence of the first one: since 

(10) \v o q n - v o q\ L 2 < \dv\ L ^ \q n - q\ L 2 < K\v\ v \q n - q\ L 2 , 

it implies that p n o q n is bounded in V and it is weakly convergent to po q. Then the convergence in V 
and Assumption [T] implies the convergence in L°° uniformly for t in a compact set. □ 

3. The stochastic model for landmarks 

The simplest perturbation of the deterministic Hamiltonian equations to obtain a second-order stochas- 
tic model is the addition of a white noise in the momentum equation. Closely related to splines on shape 
spaces introduced in [29], this stochastic model is also presented but only in the finite-dimensional case. 

(11a) dp t = -d q H(p t , qt) dt + edB t , 

(lib) dq t = d p H(p t ,q t )dt. 

Here, e is a positive real parameter and Bt is a Brownian motion on M. dn and we can think of the kernel 
as a diagonal kernel, for instance the Gaussian kernel or the Cauchy kernel (which verify hypothesis (HI) 
and (H2)). To study this SDE, we will use the ltd stochastic integral. From the theorem of existence and 
uniqueness of solutions of stochastic differential equation under the condition of linear growth, we can 



STOCHASTIC SHAPE SPLINES 



7 



work on the solutions of such equations for a large range of kernels. However in our case the Hamiltonian 
is quadratic, and the classical results for existence and uniqueness of stochastic differential equations only 
prove that the solution is locally defined. In the deterministic case, the Hamiltonian which represents the 
energy of the system remains constant along the geodesic paths. By controlling the Hamiltonian of the 
stochastic system, we will prove that the solutions are defined for all time. 
First remark that if x € M. d and a € W 1 then 

(12) (a, k(x, x)a) Rd < K 2 \a\\ d . 

Now we introduce the stopping times defined as follows: let M > be a constant and 

(13) t m = {*>0| max(\qt\,\pt\)>M}, 

let also Tqo = liniA/_ >00 f tm be the explosion time. 

Differentiating H (p iATM , qt/\ TM ) with respect to t, we get on (t < tm)' 

2 n 

dH{t) = d q H(p t , q t )dq t + d p H(p t , q t )dp t + E — ^tr(%;(t), qi {t)))dt . 

i=l 

In the deterministic case the Hamiltonian is constant, whereas the stochastic perturbation gives 

d g H(pt, q t )dq t + d p H(p t , q t )dp t = ed p H(p t ,q t )dB t . 

pTAtm rThTM rTATM 2 ™ 

/ dH(t)= s(d p H(p t ,qt),dB t )+ -^2tr(k( qi (t), qi (t)))dt, 

Jo Jo Jo z i=1 

E[H(p TATM ,q TATM )] < H(0) + E^dnTA r M ) < H(0) + {KefdnT . 



Now, we aim at controlling g (Aru using the control on dq t given by \d p H(p t , qt)\oo < KyJ ' H{p t , qt): 

i-t m M rTM/\t 



/•TM At rTM/\t 

(14) \q TM At\ < \qo\ + / KH^qs^ds < \q \ + / KH(p sATM ,q sATM )y 2 ds 

Jo Jo 

/•Too At 

<A t = \q \+ KH(p sAToo ,q sATao ) 1/2 ds . 

Jo 

However, < At P a.s. and by monotone convergence theorem (recall that H is non-negative), 

/ rthTM \ 
E(A t ) = lim (\q \ + E[ KH(p sATM ,q sATM ) l l 2 ds . 

Also, 

(15) E^ AM H(p sATKn q sATM ) l l 2 ds^ < E (J H(p sATKn q sATM ) l l 2 d.^j 

F =' E [H(p sATM ,q sATM ) l/2 ^ ds < J E(H(p sATM ,q sATM )) 1/2 ds 

cs+dj ^ / ft _ \ 1 / 2 

We deduce 



f+O /ft \ 
< Vti^J (H(0) + (Ke) 2 nds)dsj 



E(A t ) < \q \ + KVt (J (H(0) + (Kefnds) ds^j < oo and A t < oo P a.s. 
and as a consequence 

lim sup \qtAr M | < +ooPa.s. 
We also control the evolution equation of the momentum as follows, 

ftAr M ftATM 

(16) \ptAr M \ < / \d q H(p s ,q s )\ ds + \p + / edB s \. 

Jo Jo 

Now we use the assumption Q] to control d q H(p,q): 

\d q H(p,q)\ < \p\\dv(q)\ < K\p\HV 2 . 
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We rewrite inequality (fT6|) and we use Gronwall's Lemma to get: 

rtATM rtATM 

\ptAr M \< / K\ Pa \H(p a ,q a ) 1 ' 2 ds + \p + / edB s \, 
Jo J 

Wr M \< (M+supl r'^Ae/o^^-) 1 ^, 
V u<t Jo J 

\ptAr M \<(\po\+ sup I [ U edB s \) eft- XHM 1 ^ . 

\ U<tAT<x> JO / 

The first term on the right-hand side \po\ + sup u<tA7bo | j edB s | is bounded by |po| + sup u<4 1 j Q edB s \ < 
ooPa.s. and with inequality (|15p we have that 



Since on (tqo < t) one has 

lim max(\q tATM \,\p tATM \) = lim |p t | = oo , 
M— >oo M— >oo 

we deduce P(too < t) = and Too = +o° almost surely. 
We have proven for the case e(p, q) = eld, 

Proposition 2. Under assumption^ and if e : M. nd x M. nd i— )• L(M. nd ) is a Lipschitz and bounded function, 
the solutions of the stochastic differential equation defined by 

dp t = -d q H(p t ,q t )dt + e(p t ,q t )dB t 
dq t = d p H{pt,q t )dt. 

do not blow up in finite time a.s. 

Proof. To extend the proof to the case when e is a Lipschitz and bounded function of p and q, we just 
prove that the preceding inequalities are still valid. 

First, thanks to the Lipschitz property of e the solutions are still defined locally. The ltd formula now 
reads, on (t < tm) 

dH(t) = d x H(p t ,x t )dx t + d p H(p t , x t )dp t + ^tr(e T (p t , x t )K Xt e{p t , x t ))dt . 

where k x is block matrix defined by k x = [k(xi, Xj)]i<ij< n . 
We still have the inequality (|14p with 

tv(e T (pt,xt)k xt e(pt,x t )) < (Knd\e\oo) 2 

if \e(p, x)w\ 2 < |e|^|w|oo where denotes the supremum norm. Indeed, if (ei)i^[i^ n d] the canonical 
basis of R nrf , denoting e = e{x,p), we have 

nd nd 

tr(e*fc a .e) = ^(e( ei ), k x e(ei)) < X* kx J^efe), efe)) , 

i=l i=l 

where A£ is the largest eigenvalue of k x . We have A°jl < tr(k x ) = Y17=i^ T (k(xi,Xi)) and using (fL?|) we 
get ti{k(xi,Xi)) < d\* k< ^ x x s < dK 2 so that Ajj^ < K 2 nd. Hence, 

nd 

tT{e l k x e) < K 2 ndY^ klL < (Kud^]^) 2 . 

i=l 

Thus we get, 

rTf\T M fTAr M fTAr M (ZS ric ]\ F \ ^2 

/ dH(t)< {d p H{p t ,x t ),e{pt,x t )dB t ) + K - l-^dt, 

Jo Jo Jo 1 

E[H(T A tm)} < H(0) + fl( (^H £ l°°) 2 T A r M ) < H(0) + (Knd\eU 2 T , 

and all the remaining inequalities follow easily with the control on H and the bound on e. □ 
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The first comment is that this model perturbs as expected the trajectories of the deterministic system 
and the model provides realistic evolutions for biological shapes contrary to Kunita flows. When e — > 0, 
the solutions of the system (fTT|) converge to the corresponding geodesic e = 0. The first simulation^ in 
figure Fig. [3] represents the geodesic evolution of a template (40 equidistributed points on the white unit 
circle) to the target (40 points on the white ellipse deduced of the initial points with affine transformation) , 
the color change from blue to red represents the time evolution from to 1. The kernel is a Gaussian 
kernel of width 1.0. The other three simulations are perturbations of this geodesic evolution in which 
we progressively increase the standard deviation of the white noise from e = 0.9 to 1.7 and 3.5. Remark 
that we have normalized the noise by dividing with the square root of n = 40 as it will be suggested by 
extension to the infinite-dimensional case. It means that the total variance of the noise in the system is 
equal to de 2 where d is the dimension of the ambiant space (d= 2). 

The relative smoothness in time is evident in comparison to the simulations of the first order stochastic 
model. 



FIGURE 3. Geodesic evolution - 40 FIGURE 4. White noise perturba- 

points on the unit circle. tion of the geodesic - e = 0.9 




FIGURE 5. Increasing the variance FIGURE 6. Increasing the variance 

of the noise - e = 1.7 of the noise continued - e = 1.7 

3.1. Toward the stochastic extension. Back to the stochastic Hamiltonian system, a natural limit of 
the system (fTTj) appears when increasing the number of landmarks: roughly speaking the energy of the 
noise should be kept constant. Therefore the Brownian motion in the system (jlip could be interpreted 
as the projection of a cylindrical Brownian motion on L 2 (Si,M 2 ). A white noise on the particles can be 
extended to a white noise on the parameterization of the shape. However we would like to deal with more 
general noise than the white noise related to that particular parameterization, this is the reason why a 
general variance term will be studied. 

Let us first discuss this extension from a heuristic point of view. 

We give a short definition of the white noise on H = L (5i, /x, M. 2 ) with \i the Lebesgue measure. We will 
come back to this definition later on. 



We used a simple Euler scheme to simulate the SDE 
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Definition 1. Let (B l )fJ^ be a family of independent real valued Brownian motions and {ei)f^ an 
orthonormal and complete basis of H. The process Bt = ^t e i ^ s ca ^ e d a cylindrical Brownian 

motion on H . 

Our approach leads to the following equations, 

(17a) dp t = -[p t dik(q t ,q t (s))p t (s)ds]dt + edB t , 

JS! 

(17b) dq t = [ k(q t ,q t (s))p t (s)ds]dt . 

J Si 

There are important issues to be discussed in the structure of this stochastic system. We study these 
Hamiltonian equations (fTT|) with q € Q and p £ P for P and Q some undefined Hilbert spaces. This 
study will provide us with some informations on suitable spaces to develop our approach. 
We want Q to contain a large set of piecewise constant functions to account for the landmark case as 
described above for any number of particles . 

Property 1. Piecewise constant (at least for a large range of partitions of Si in intervals) functions are 
contained in Q such that the case of landmark can be treated within this space. 

To properly define the term fg k(., qt(s))pt(s)ds in equation (Il7b|) . we can add these two following 
hypothesis 

Property 2. P and Q are dual and we have the injections 

Q^t L 2 ^ P. 

Property 3. 

If K is a smooth function, f£Q>-^-Kof£Q is locally Lipschitz. 

Now the term J s k(.,qt(s))pt(s)ds is well defined by k q p(.) = (p,k(.,q))p,Q. If k q p(.) is sufficiently 
smooth, then the last property gives a sense to (|17b|) : 

dqt = k q p o q dt . 

Let us study equation (|17ap which can be rewritten as 

dpt = ~Pt (dv q p oq)dt + edB t , 

with dv q p(.) = (p,d\k(.,q))p t Q. If this map is smooth enough, dv q poq £ Q thanks to property [3j To give 
a sense to p{dv q p o q) £ P, we ask for the following 

Property 4. Q is an algebra, the multiplication is continuous for the norm on Q. 
Indeed if p £ Q and qo £ Q, then we can define p.qo 6 P defined by: 

(p.qo,q)p,Q = (p,qoq)p,Q , 

the right-hand term being continuous w.r.t. q since the product is continuous. 
Finally the noise term should belong to P as follows, 

Property 5. The paths of the cylindrical Brownian motion t —> Bt lie almost surely in C([0,T],P) for 
all T > 0. 

This last property ends to give a sense to equation (|17ap . 
This set of conditions is a guide to get a proper space to prove the results. It is well known that if 1 (S'i) 
satisfies all these properties but it does not contain piecewise constant functions. We will present in 
the next section a candidate for (P, Q) that fulfills all the previous properties in any dimension (curves, 
surfaces, . . .). 

Once the system is well-posed, the other issue to be discussed is the existence of solutions to this sto- 
chastic system on P, Q and the convergence of the projections (landmark case) to the infinite-dimensional 
case. As we want to be slightly more general on the noise term, we will tackle the case when 

e : P x Q ^ L(P) 

is Lipschitz and bounded which would be a natural extension of proposition [2j 
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4. The Hilbert spaces F s = Q and F_ s = P 

In this section, we present the spaces P, Q that verify all the properties of 13.11 At first sight, we could 
think about a Sobolev space on the Haar basis. Hopefully the properties we need would be verified. 
However, it is not convenient to work with Sobolev spaces on the Haar basis to prove the Lipschitz 
property of the composition with a smooth function. This is our motivation to slightly modify this space 
by defining the space F s = Q for s > and F- s = P which are well suited to easily obtain the required 
properties of subsection 13.11 



Recall that H = L 2 (£"i,M), we consider the Haar orthonormal basis with i/jo(x) = X[o i[ — X[I i[ an d 

4>n,k(x) = 22"V'o (2 n (x — ^-)) for n > 1 and < k < 2 n — 1 and the constant function tp-i.o := 1. 
We define the Haar coefficients of a function / G H by 

fn,k = (f,1pn,k)H , 

for n e [-1, +oo[ and k G A n = [0, 2 n - 1] if n > and A_i = {0}. 
Let us start with a simple remark. 

Remark 2. Let g G L°°(Si,lR) be a function, we have 

. . Ill; | — I I 

\9n,k\ < \9\oo\Wn,k\L^ = 2 2 \9\ 



oo • 



Definition 2. We define H s = {/ G |/|^ = E^=-i EfceA„ 2n 1/n,fc| 2 < +oo} ; with s>0 a nonnega- 
tive real number. For s < 0, we define H s as the dual of H- s . 

We study some properties of an element in this Hilbert space. 

Proposition 3. An element f G H s for s > 1 is continuous in every x G [0, 1] which is not a dyadic 
number, more precisely, if a = |tqrf with an integer k such that 2k + 1 G [0, 2 n+1 — 1] and (x, y) G 

B(a, ^pr) 2 , then with C 2 = Etc? 2 ~ l(s ~ 1] = 

(18) |/(aO-/(|/)|<C.— ^l/lfl.. 

Proof. We define for x G [0, 1] and n > — 1, 

4r,n = {A; G A n , | X G Supp(V'n,fc)} ■ 

Remark that for each n there exists one and only one k in A x n . We will use this remark in the next 
inequalities. Also, the difference \f{x) — f(y)\ does not involve terms in the sequence that are constant 
on the ball B(a, 2n 1 +1 ), thus we have with Cauchy-Schwarz inequality and using the remark (j2J), 

\f{x)-f{ y )\ < E I E \f^+ E 

l>n \k&A x j k&A y>l 



\f(x)-f(y)\ < 2\f\ Hs £2-'(-D, 



which is the result. □ 
Remark 3. This proof gives also that the sup norm is bounded by the H s norm for s > 1: 

\f\oo<C s \f\ Hs . 

Now, we introduce the suitable Hilbert space F s . 
Definition 3. We define the Hilbert space for s > 0, 

F s = {f£H\\f\ 2 = /V^ + E 2 ™" 1 f l/(x + -J rT )-/(x)| 2 dx<oo}, 
Jo n,k Jl ^ 2 

with I n) f. = [^-, 7^- + 2 n+i ] ■ ^ s dual is denoted by ii_ s . 
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We have the following inclusion 

Proposition 4. We have the inclusion F s C H s and if s > 1 and 

\f\H.<\f\F.. 

Proof. To see this fact, we apply the Cauchy-Schwarz inequality 

flk = 2 n (f f(x+^)-f(x)dx) 2 , 



2 1 f 1 

fn,k - o / \f( X + 2^+1 



f(x)\ 2 dx 



Moreover, 



(/ f{x)dxY< / fixfdx, 
J Si JSi 

so that we have \f\n a < |/|f s - D 

We want our space to be big enough to contain usual functions. In the following, we prove that F s contains 
Lipschitz functions for s < 2 and also, if s < 2: 

^Pdyad(Si) = {/ G L 2 (5!,M)|3n, f\ In k G Lip(I re , fc , R) VA; G [0,2 n - 1]} C F s . 

This fact is important since it means that we can deal with a wide range of shapes in this space. 

Proposition 5. If s < 2, F s contains piecewise Lipschitz functions, 

L *Pdyad(Si) C F s . 

Proof. Let / G Lip(Si,R) be a Lipschitz function and M be its Lipschitz constant. Then we have 



ins— 1 



i M2 ns ~ 1 

l/(^ + ^Tr)-/^)l 2 ^< 



23n+3 

so that if s < 2, / G F s . □ 

The following proposition is needed to ensure the stability of our stochastic system. For example, if G is 
Lipschitz and bounded, the growth of G o / is linear: 

Proposition 6. If s > 1, G a real Lipschitz function and f G F s , then G o f G F s and also, 

\Gof\ Fs <Ltp(G)\f\ Fs + \Gof\ L2 , 
1 ' \Gof\ Fs <L ip (G)\f\ Fs + \G(0)\. 

with Lip(G) the Lipschitz constant for G. 
Proof. Applying the Lipschitz property we have, 

/ |Go/(x + ^ jT )-Go/(x)| 2 ( ix< f Lip(G) 2 |/(^ + ^r)-/(^)| 2 ^, 

then, 

(20) \G o /|f, - \G o /| 2 2 < Lip(G) 2 (|/|f s - |/| 2 2 ) . 

Since for any couple (a, 6) of nonnegative real numbers a 2 + b 2 < (a + 6) 2 , we have the first inequality. 
The second inequality is the application of inequality (|20p to the function g = Go/- G(0) using the 
inequality |flr| i2 < Lip(G)|/| L 2. □ 

We need to go further by proving that the composition is locally Lipschitz if G 1 is Lipschitz. 

Proposition 7. If s > 1, G a real C 1 function such that G' is locally Lipschitz then, for any r > there 
exists M > such that 

IGo/i-Go/a] <M|/!-/ 2 |, 
(/l) /2) G B(0,r) 2 . If G' and G" are bounded then the Lipschitz constant M has linear growth, 

M< V2(|G'| 00 + 3G s r|G"|oo). 
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Proof. For notation convenience, we will denote by for i = 1, 2 and 5 > 0, 

A/iOc) = + 8) - fi(x) . 

We will control the quantity 

( |(Go/ 1 -Go/ 2 )(x + -i jT )-(Go/ 1 -Go/ 2 )(x)| 2 dx. 

We will divide by A/i, it is permitted in this situation, since we can extend the definition with the 
equation (|22l) . Let a < b be two real valued numbers. We have, with (i the Lebesgue measure 



(21) / 6 |A(Go/ 1 - G o/ 2 )|^<2 A^f^A/.-^f^A/^ 

Ja ia A Jl A /2 



Z- 6 A(Go/ 2 ) A(Go/ 2 ) 2 

+ U A A^ /2 ' ^ 

Observe that the second term can be bounded easily: 

f\ A(Gof 2 ) A ^(Gof^ 2 f" |W, ^2|A, Af |2, 

/ I — t-; A/i — A/ 2 | dfi< { sup |G(y)|) |A/i - A/ 2 | d/z, 

Ja A /2 ^/2 Ja |j/|<C s r 

and we have the Lipschitz property on this term. Now we bound the first term. Remark that 

(22) H %! l) {x) = Jo G '( tA ^ + ^ dt ' 

we get, 

MGofr) A(Go/ 2 ) 



OO — 



[ sup \G"{y)\\t&{h-h) + h-h\oodt. 

J0 \y\<3C B r 



' AA A/ 2 

Since for \t\ < 1, |*A(/i - f 2 ) + fi - /2I00 < 3|/i - f 2 \oo < 3C s |/i - / 2 |f s , we obtain, 
^(Go/J A(Go/ 2 ) 



A/l A/ 2 °° Ij/l^ar 

Back to the inequality (121 p . we obtain 



< sup \G"(y)\3C s \h-f 2 \ Fs 



[ b \A(Gof 1 -Gof 2 )\ 2 dx<2[\ sup \G'(y)\) 2 \A(f 1 -f 2 )\ 2 d f ,+ 

J a J a \y\<C a r 

f b ( sup |G^'(j/)|3C a |/i-/ 2 | J r. > ) lA/il 2 ^. 

Ja \|y|<3C s r J 



2 

Remark also that on the L 2 norm, applying the Lipschitz property, 



\G o f, - G o f 2 \ 2 L2 < sup \G'(y)\ 2 \h- f 2 \\ 2 . 

\y\<C 3 r 



We get the result, 



\Gof x -Gof 2 \l s <2 ( sup |G'(y)|) 2 + ( sup |G"(j/)|3C fl ) 2 |/il^ l/i - Mf,, • 

\ \y\<Csr \y\<3C s r J 

To be more precise in the proposition, we obtain the following inequality on the Lipschitz constant of the 
composition on every F s ball of radius r > 0: 



(23) M< 2{ sup |G'(y)|) 2 + 2( sup \G"{y)\3C s r) 2 . 

V \y\<C a r \y\<3C s r 
The linear growth of the Lipschitz constant is the direct application of this inequality. □ 

Proposition 8. Let K : W \-t R be a C^R^R) function with K' locally Lipschitz, s > 1, then 
. . . , fj) £ (Fs) 1 l— >• K(fi, ■ ■ ■ 7 fj) G * s Lipschitz on every bounded ball. 

We do not give the details of the proof of this proposition since it is a particular case of a generalization 
of this proposition which will be stated in proposition [T3j A direct consequence of this proposition is that 
F s is an algebra. In the next proposition, we give an explicit bound for the continuity of the multiplication. 
Even if it is a direct application of the last proposition, we can give a better bound. 
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Proposition 9. The product in F s is continuous for s > 1 and, 

\fg\ Fs <2C s \f\ Fs \g\F s . 

Proof. First we bound the I? norm 

\fg\h<\f\ 2 oo\g\h, 
\fg\h<c 2 \f\ 2 Fs \g\h- 

Now with the inequality 

\A(fg)\ 2 <2(\g\ 2 00 \Af\ 2 + \f\ 2 00 \Ag\ 2 ), 
we obtain the result \fg\ 2 F < AC 2 \f\ 2 F \g\ 2 F . □ 

The first natural generalization in two dimensions of H s is the tensor product H s (g) H s i. We could do 
the same for F s but we prefer a slightly different definition of a space F s s i (Although it turns to define 
exactly the tensor product F s <%> F s >). We will take advantage of this definition to extend the composition 
property. 

Definition 4. Let (s,s') be two positive real numbers, the space F StS > C L 2 (T2) is defined by 

F s>s , = F S (S 1 ,F S/ ), 

in the following sense with = [^r, + 

/ l/l^^ + E 2 ™" 1 / l/(*+2^r)(-)-/(*)(-)l^<°o- 

JSl n,k Jln - k 

Remark 4. This definition can be rewritten in a more explicit form, 

F S ,AT) = {feL 2 (T)\\f\ 2 F =f \f( x ,.)\ 2 dx+ [ \f(.,y)\ 2 F3 dy + 

JSi J Si 

(24) ]T 2 ns+n ' s '- 2 f f \A 2>n ,(A ljn f)\ 2 dxdy < oo} , 

n,k,n',k' ^ In ' k Jl n',k' 

with A 1>n f = f(x + 2^ft,?/) - f(x,y) and A 2 , n f = f{x,y + i^r) - f(x,y). 

In what follows, we will denote c 2 ^^,^ := J Ink J In/ fc , \A 2y n'{^i,nf)\ 2 dx dy. 

As in the one-dimensional case, the injection F s s / H s s i would be again a straightforward application 
of Cauchy-Schwarz inequality. However we provide a different proof using the following proposition: 

Proposition 10. As defined m[7J we have 
and as a consequence, F s s / H s s i . 



F s , s > = F S ® F s , , 



Remark that the identification is here allowed since each of the two spaces are L 2 subspaces. 

Proof. Let (n, k), (n' , k') be two couples of integers, then {4> n ,k®'4 , n' ,k')(n,k),M ,k') * s an orthonormal Hilbert 
basis in F s <S) F s i by the definition. From the remark this is also true in F SjS i. 
If u <8> v £ F s <g> F s i , then 

\u®v\ Hss , = \u\ Hs \v\h 3 , < \u\ Fs \v\f s , , 
and the second assertion is verified. □ 

Now we prove that if / is sufficiently smooth then / belongs to F ss >. It requires to control one more 
derivative than in the one-dimensional case. 

Proposition 11. Let f be a C 1 function such that y — > d\f(x,y) is Lipschitz uniformly in the first 
variable x, then f £ F s s > for s < 2 and s' < 2. 
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Proof. We will denote by Lip 1 2 the Lipschitz constant in the second variable of d\f . We need to estimate 
the integrals detailed in (|24p . we will denote by ci n ^\i n i each integral. Using the Lipschitz property 
we have 

i 

-(n'+n+2) 



f x +^+T 1 

|A 2) n'(Ai,n/)| < y \dif{u,y+ ) - dif(u,y)\du < Lip 12 2" 

/ / |A 2in ,(Ai,„/)| 2 dx^ < Lip? 2 2- 3 ( n ' + " +2 ). 



Then, we have 

c (n,k),(n',k>) 

Summing up on (k, k'), we get that 

E ns+n's'-2 2 ^ t -2 r,n(s-3)+n'(s'-3)-8 

Z C (n,ifc),(n',fc') - 2^ ^Pl.2 2 

(n,fc),(n',fc') (n,k),(n',k') 

n,n' 

In the equation (|25p . the right-hand side converges if s < 2 and s' < 2. To conclude the proof, the first 
two terms in the F s 8 i norm according to the formula (f24"|) are well defined thanks to the proposition [5] 
which requires s < 2 and s' < 2. □ 

Remark 5. Again, any function for which there exists a finite dyadic partition of T such that the re- 
striction of f on each domain of the partition satisfies the condition in the proposition [TJJ belongs to 

Next, we will state the relevant inequalities to prove the needed properties. At this point, it is worthwhile 
to generalize a little the spaces we introduced in order to extend our results to any dimension. Observe 
that F s is a Hilbert algebra of functions. A way to generalize our result is to study F S (S\,F) where F is 
a Hilbert space of functions which is also an algebra. Although we could be more general, we will assume 
further that F C L 2 (T n ) where T n is the n-dimensional torus: T n = M n /Z n . As in the previous definition, 

Definition 5. Let s > be a positive real number, the space F S (F) is by 

F s (F)=F s (Sx,F), 

in the following sense: 

with I n!k = [i, ^ + ^HTr], a function f G L 2 (T n+ i) belongs to F S (F) if 

\f\F s (F)--= [ \f(x)\ldx + J2* nS - 1 I \f{x + ^)-f{x)\ 2 F d X <^. 
JSl n,k Jl ",k 

We have 

(25) F S (F) = F s ® F . 

The last equation (|25p uses the same argument as in proposition 1101 

Proposition 12. Let us assume that F is a RKHS on a space X and that there exists a constant C F 
such that sup^gj^ 1/(^)1 < C F \f\ F . If s > 1 then the following inequalities hold for f G F S (F) = F s ® F, 

sup \f(s)\ F < C s \f\ Fs(F) 
sup |Ai/| F < C s \Aif\ Fs ( F ) 

sup \f(s,x)\oo < C s C F \f\ Fs{F) , 

(s,x)eSxxX 

where Aj is a difference operator defined for 5 > as (A\g)(x) = g(x + 5) — g(x). Moreover proposition 
is also verified. 

Proof. If u G F S ®F, then u = I]n,meN 2 a n ^ m e n ® f n , with (e n ) neN and (f n )neX Hilbert basis respectively 
for F s and F. By definition, X^nmeN 2 a nm < 00 • Hence, we have, 

tt = ^ a n,mdn) <8> fm = E m ® f m . 

mSN nSN meN 
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Then, we can apply the evaluation at point z E Si since F s is also a RKHS. We denote by C z the norm 
of the evaluation at point z G Si', the sequence X]m=o E m {s)fm is a Cauchy sequence in F since 

^ ^ rkhs prop ^ 

As a consequence, the evaluation at point 2 G Si is well defined and it makes the space F s ® F a RKHS 
on Si with values in F. Furthermore, as C z < C s , we have: 

sup \f(z)\ H < C s \f\ Fs{F) . 
zeS! 

The second inequality is the application of the first one to Aif and the last one just uses the assumption 
on the RKHS F. □ 

Now, we can easily generalize the work done in one dimension. 



Proposition 13. Let F C L 2 (T n ,W k ) for k > 1 be a RKHS algebra with a continuous injection in 
L°°(T n , K fe ). Assume that the left composition with an element H G C'(R , M. k ) 

F3g^Hog£F 

is Lipschitz on every ball B(0,r) of constant Cff(r). Then, 

• ifGe C l+l (R k ,R k ) , the composition 

F S (F)3 f^Gof <=F 8 (F), 

is Lipschitz on every ball, 

• with the additional assumption that the left composition with G' and G" in F are locally Lipschitz 
such that there exists a polynomial real function P verifying max(Cc"(r), Cc(r)) < P(r) for r > 0, 
then there exists a constant depending on F and s, a G M + such that the Lipschitz constant Cq p s ^ 
for the left composition with G on F S {F) 

C G ,F s (F)(r) < arP(r) . 

Proof. We first need to prove that if / G F S (F) then G o f G F S (F). With the proposition 1121 we have 
that 

(26) sup |/(x)| H < C s \f\ Fa(F) . 

xeSi 

Then, we obtain for the first term in the norm, 

f \Gof- G(0)\Ul* < C 2 s C 2 G {C s \f\ Fa{F) )\f\ 2 Fs{F) . 

J Si 

For the term involving the difference, we need to introduce again the formula, 

(27) A x (Go f) = ( / G'(tA x f + f){A x f)dt) , 

J 

which is now allowed since G' is C l . The formula ( 1271) uses the fact that F C L 2 (T n ,R k ) to give a 
sense to the composition. As F is an algebra, we have G'(tA x f + f)A x f G F. Obviously we have also 
tA x f + / G B F (0,3ro) for \t\ < 1 and ro = C s |/|^ s (^). With the inequality ([26| . we get 

(28) \G'(tA x f + /)A x /|jr < 3Mr \A x f\ F C G ,(3r ) , 
with M the constant associated with the continuity of the multiplication in F: 

V(f,g)£F 2 , \fg\ F <M\f\ F \g\ F . 

Remark that G'(tA x f + /) can be seen as a matrix valued function. We use the matrix norm implied by 
the Euclidean norm on R fc . The inequality (|28p directly proves that G o f G F S (F) with in addition: 

\Gof- G(0)\ 2 Fs{F) < [max(3Mr C G ,(3r ),C s C G (r ))] 2 \f\% s{F) . 
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We now prove the Lipschitz property: 

let fi and f 2 be two elements in F S (F) 2 with max(|/i|p s (^), |/2|f s (F)) ^ r i- With the Lipschitz property 
of the composition on F we have with r 2 = C s r x , 

(29) / \Gofx{x)-Gof 2 {x)\ 2 F dx< [ C 2 G (r 2 )\fx(x) - f 2 (x)\ 2 F dx . 

JSi JSi 

For the remaining terms, we use again the formula ([27]): 



\A X (G o f x - G o f 2 )\ 2 F < 2M 2 [\A x (fi ~ f2)\U I \G'{tA x fx + fx)\ F dtf 

Jo 

+ \A x f 2 \ 2 F ( ! \G'(tA x fx + h) - G'(tA x f 2 + f 2 )\ F dtf] . 
Jo 



(30) 



The last term of inequality (|30|) can be bounded as follows 
(31) 

We then obtain, 

I A, (Go f x - Go f 2 )\ 2 F < 2M 2 [\A x (h - f 2 )\ F (3r 2 C G ,(3r 2 )) 2 

+ \A x f 2 \ 2 F (3C s \fx - f2\F 3 (F)C G '(3r 2 )) 2 } . 
For notation convenience, we define K{r\) := 3r 2 Cc(3r 2 ) and we finally get, combining equations ([29 



/ \G'(tA x h + fx) - G'(tA x f 2 + f 2 )\ F dt < 3C s \fx - f2\ F3 (F)C G '(3r 2 ) 
Jo 



and (|32j) 

(33) \Gofx -Gof 2 \ 2 Fa(p) < m & x(AM 2 K 2 (n),C 2 G (r 2 ))\fx - f 2 \ Fs{F) ■ 

This inequality implies directly the last item in the proposition. □ 

We have presented all the material necessary to generalize easily our results. We generalize F s in dimension 
n > 3 as it is already done in one and two dimensions. 

Definition 6. We define by recurrence F s where s = (sx, ■ ■ ■ , s n ) G Wl by for n > 3, 

FsdSuF is2 _ Sn) ) = F sl ®...®F Sn . 
We denote its dual F_ s , S* = minj e n n i Sj and s* = maxj g r l n ] Sj. 

To sum up our work to this point, we have defined a RKHS algebra F s for a multi-index s which is stable 
under the composition with smooth functions. The continuity of the product is detailed in appendix with 
proposition [26] (it is also a byproduct of the previous result on the composition with smooth functions in 
proposition I13f> . We will now prove that F s is big enough. Provided that linear functions are in F s , the 
proposition of the composition 1131 answers this question. We can have a better result: 

Proposition 14. If s* < 2 and f G C n (T n ,M. k ) then f G H s and \f\ Hs < Cn\f\ n>00 . 

Proof. By recurrence, this true for n = 1. With the inequality, 

l/lk < / Cl_x\f(x)\l_x i00 dx + J2^ 1 / ( r +2 " +1 Cn^dxfU.x^dxf , 
J Si u Jl n ,k Jx 

34 n ' h 

v ' oo 

i/il^cLj/i^a + E 2 ^"^ 4 )- 

n=0 

We have the result with c 2 n = 0^(1 + ^^° =0 2 n ( s " 2 )- 4 ). □ 

As a direct application of this proposition, we get 

Definition 7. If n >2, a dyadic partition of T n is a product of a dyadic partitions in one dimension. 

Proposition 15. If max s < 2 and f G L 2 (T n ,M, k ) such that there exists a dyadic partition on which the 
restriction of f is C n then f G H s . 

The space of functions such that the restriction is C p on a dyadic will be denoted Cf yad (T n , R k ). In the 
next section, we will present the cylindrical Brownian motion and we will prove that almost surely its 
trajectories are continuous paths in H_ s , therefore in F_ s . To sum up the properties of F s , 
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Theorem 1. The Hilbert space F s C L' 2 (T n ,M. k ) satisfies the following properties 

• the left composition with a function G G C n+1 (K fc , M. k ) is locally Lipschitz, 

• if s* > 1 then F s is an algebra with continuous product, 

• the cylindrical Brownian motion defines a continuous random process in F- s , 
. ifs*<2thenC p dyad (T n ,R k )cF s . 

We can now deduce an important property to prove the existence for all time of the SDE solutions. 



Proposition 16. If the kernel k has continuous derivatives, 

d l+n k(x, y) 



dixd Tl y 



l,n G [l,m + 2] , 



a couple (p,q) G F^ s x F s defines an element ofV by k q p(x) = (k(x, q) , p) f s xF_ s , with s = (s\, . . . ,s m ). 
Moreover, the following mappings are Lipschitz 

(35) F_ s xF s 3 (p, q)^k q poq£F s , 

(36) F_ s x F s B (p, q) h+ (p, (d x k q p) o q) F _ sXFs G F_ s . 

Proof. First, for any x, k q p{x) is well defined: since y i— > k(x,y) is C m+2 , we apply the Theorem Q] to get 
k(x,q) G -F s . Hence, k q p(x) is well defined. Our goal is to prove that k q p{x) is C m+2 and d x k q p is C m+1 . 
Thus we would obtain that k q p £ V. The composition with a C m+1 function being locally Lipschitz on 
F s , the results will follow. 

To prove the continuity of x i— > k q p(x), we just need the weak convergence in i 7 ^: 

711— >00 

when limn^oo x n = 

We first prove that k(x n ,q(.)) k(x,q(.)): thanks to the injection F s <^-> L°°(T m , IR 01 ), |g|oo < ro- 

Since A; is continuous, it is uniformly continuous on W x 5(0, ro) with VF a compact neighborhood of x. 
Then, for any e > 0, there exists 5 > such that if \x n — x\ < 5, we have \k(x n , y) — k(x, y)\ < e and as a 
consequence |fc(x n ,g) — k(x,q)\ oc < e. 

We now prove that k(x n , q) is bounded in F s : as dyk{x, y) for n G [1, m+ 1] is bounded on any compact 
set, we get that k(x n ,q(.)) £ F s is bounded in F s . 

Since L 1 C L°°(T m ) / C -F_ s (thanks to F s •— > L°°(T m )) every weak subsequence of k(x n ,q(.)) converges 
to k(x,q(.)). Then, lim nh ^ k q p(x n ) = k q p(x). Therefore k q p is continuous. By the same proof, k q p is a 
C 1 function: 

as k is C m+1 , we apply the same argument to k i p i x+tn ^ k iP( x ) _ 5 1 fc g p(x)(f) for v € M rf and t ^ 0. We 
have, 

fc g p(g + t n v) — k q p x _ g^p^^ _ I dik q p(x + st n v, q){v)p - d 1 k q p(x)(v)ds . 



Jo 

The sequence d\k q p{x + st n v,q(.))(v) — d\k(x , q(.))(v)ds converges in L°° to by uniform continuity 
of d\k on every compact set. It is also bounded in F s since d\k is C m+1 in the second variable. We get 
the same conclusion as above. 

Since the pointwise derivative d\k q p(v) is continuous (by the same argument than for k q p we have that 
d\k q p(v) is continuous) d[k q p] = {d\k) q p. 

By recurrence the result is extended to d™kq p for n G [l,n + 2]: we obtain that H = ^(p,k q p) < oo and 
k q p G V. 

To prove that the mapping (p, q) \— > k q p is Lipschitz on every compact, the composition is Lipschitz on 
every bounded ball if d\k is C m+1 in the second variable. Hence we deduce that for each xq, the maps 
q G F s i— > k(xo,q) G F s and q G F s i— )■ dik(xo,q) G F s are Lipschitz. The Lipschitz constant can be 
bounded for xo G by continuity of the kernel derivatives. 

As the dual pairing is Lipschitz we obtain the result. Then by triangular inequality we also obtain that 
k q p o q is Lipschitz in both variables and so is {p, (d x k q p) o q). □ 
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5. Cylindrical Brownian motion and stochastic integral 

The goal of this section is to define the stochastic integral u{x)dB x for u a suitable random variable 
with values in F s . We will give a self-contained presentation inspired by provided basic knowledge 
of the Ito stochastic integral. However we aim at presenting it in order to keep up the finite-dimensional 
approximations for landmarks. 

First we provide an elementary and self-contained introduction to the cylindrical Brownian motion in H . 
The construction here puts the emphasis on the finite-dimensional approximations obtained by projection 
on finite-dimensional subspaces which are the counterpart in the noise model of the finite-dimensional 
approach with landmarks. We will then present in|36]the stochastic integral. 

5.1. Cylindrical Brownian motion in L 2 (Si,M). We start with the simplest situation where the un- 
derlying space in the one dimensional torus Si and H = L 2 (Si,M). 

Let (B n ' fc ) n >o i fc6 J 4 n be a collection of continuous independent standard one-dimensional Brownian mo- 
tions (BM) on 5F, P) a probability space. For any n > 0, and consider the H valued random process 

n-l 

w t = E E B t k ^,k ■ 

l=-i keA t 

At a given time, the coefficients of in the orthonormal basis of H are i.i.d. Gaussian variables with 
variance t (truncated at rank n). Moreover, since 

(37) H n = Span{ -1 < / < n, k G A n } 

is the 2 n -dimensional space of piecewise constant on the dyadic partition of S 1 at scale 2~ n , WJ 1 € H n 
is obviously a random piecewise constant function. Moreover, for any / E H n f = Ylb=-1 X]fceA ; fl,k^l,k^ 
we get 

(38) (/, WDh = E E fi* B t k ~ *(0, M 2 h) ■ 

l=-\ keAi 

More generally, for any /i, /2 £ H n , ((fi, W™)h, {f2, W™)h) are jointly Gaussian, centred with covariance 

(39) T id = E((fi, Wp)n{fj, W^)h) = (fiJj) H . 

In particular, if we introduce 4>n,k = 2 n ^ 2 l[k2- n ,(fe+i)2-™[ f° r any < k < 2 n — 1, the (/> n ,fc' s define an 
orthonormal basis of H n . Denoting 7™' fc = (cf>n,k,Wp}H, we get from (I38p and (I39D that 

2 n -l 

(40) W? = 2"/ 2 J?'%2-«,(k + i)2^[ 

k=0 

where (j™ ,k )t>o is a i.i.d. family of 2 n standard Brownian motions indexed by k. 

A cylindrical Brownian motion on H is the limit of W™ when n — > oo. A well known but important 
fact is that this limit is not defined in H since E(\W™ +:I | 2 ) = t2 n — > +oo but in any H_ s for s > 1. 
Indeed, \W? +j - W? +j '\%_ s < < t = £~ =n+1 2— ZkeA m l^'Y so that 



E( sup \W t n+3 ~ Wr r \l_ a ) < E(Rl >t ) = C n , s t 
j,f>o 

with C ns = 2( n+1 ^ 1_s )/(l — 2 l ~ s ). Therefore a.s., WJ 1 is a Cauchy sequence in H_ s and one can define 
Wt as the limit in H- s of WJ 1 . In fact, it will be helpful to do a little more. Since the process t — > W™ 
has continuous trajectories in H s , one can look for a limit in C(M.+ ,H S ) for the uniform topology. 
For any T > 0, we have 



sup sup \wr +j -w t n+j, \%_ 3 <R 2 n = e 2 ^ /s E su p 



so that using the Doob inequality E(sup 0<t<T Bf ) < AE(B 2 ) for the standard Brownian motion, we get 

E (sup sup \W^ 3 - W t n \ 2 H ) < 4C n , s T. 

\j>0 0<t<T I 
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Hence a.s. t — > W™ is a Cauchy sequence in C([0, T], H- s ). Since T > is arbitrary, we can define a 
limit process W living in C(R+, H^ s ) such that for any T > 

E( sup \W t -W?\ 2 H s )<4C n , s T. 
o<t<r 

5.2. Cylindrical Brownian motion in L 2 (T m ,R). For a general m > 1, since L 2 (T m ,R) = L 2 (Ti,M)<g) 
• • • 1? (Ti , R) , the construction of the is built from the Hilbert basis obtained by usual tensorisation. 
To be more explicit, we denote by 

for any Z = (l^)i<i< m and fc = (&W)i<i< m such that > -1 and fcW E for > -1. Now, if 

I n = { (l,k) | < n, l<i<m} 

fl"=span{$£ | (l,k)El n } 
and Iqo = U n >o/ n > we define from a family (S Z ' fc )(z,fc)e/ 00 of i.i.d. standard BM 

(41) w? = E ^v-ft- 

(i,fc)e/« 

—1/2 

As previously, if / 6 £P\ we have t —> \f\ H 1 (/, W t n ) is a standard BM and for any f,gE H n , 

(42) ((f,W?)(g,W t n ))=t(f,g) H . 



In particular, if 

<£™fc = 2mn/2l n-'I 1 [fcW2-™,(fcW+l)2-"[i fcW G [o 5 2 "I 

the family (4>™k)kelo,2 n l m is an orthonormal basis of H n based on a dyadic partition of T m in cells of size 
2~ n x • • • x 2~ n . As previously, we have 

(43) w?= Y, W.<*><* = 2 Bra/a E it'% T=l[ km-n,^ +1) 2- n[ 

fce{0,-2™-l} m fce{0,---2 n -l} m 

where (^ n > fc ) is a family of i.i.d. BM. 

For H s = ®i^iH- Si , with s = (s±, ■ ■ ■ , s m ), we get immediately that W™ is a Cauchy sequence in H s as 
soon as s* = min^ Sj > 1 converging uniformly on any time interval [0,T] to a process £ C(R+,-ff_ s ). 
More precisely, 

(44) E( sup |W t - W t n \ H _ s ) < 4C n:S T 

0<t<T 

withc n , s , = (E^ +1 2-^- i )r. 

5.3. Cylindrical Brownian motion in H = L 2 (T m ,R rf ). For a general d > 1, the previous definition on 



cylindrical Brownian motion can be extended easily in the more general situation where H = L 2 (T m ,] 
Indeed, we define W = (W^, ■ • • ,W^) where i<i<d is a family of i.i.d. cylindrical Brownian 

motions in L 2 (T m ,R) as defined previously. The finite dimension approximations are defined accordingly 
on 

(45) tf" = span{(^ fcl ,--- ,^ kd ) \ (lj,kj) G I n 1 < j < d } . 

In this case, there is an analog of inequality (j45]), with the constant 

oo 
l=n+l 
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5.4. Stochastic integral. We assume basic knowledge of the ltd integral and we directly deal with the 
general case on H = L 2 (T m , M. d ). We recall that F s H P- s . Having in mind applications that we 
will develop later, we need to introduce the space of integrands. 

Let us denote by L(P_ S ) the space of continuous endomorphisms of F_ s . If u G L(P_ S ), then there exists 
a constant denoted by \u\ such that 

\u{e)\ F _ s < M|e|j!-_,. 

Definition 8. The set Lt contains all random variables u : [0,T] xfl4 L(F^ S ) verifying, 

• (t,co) —7- u(t, u) is S[0, T] <g> A measurable, 

• uj — > u(t,u) is 3*t— measurable for t £ [0, T\, 
. | T ^[Ki)| 2 ]^<oo. 

Now, we want to give a sense to 

rT 



(46) 

for u £ Lt- To this end, we first define 



u{t)dW t 



(47) 



t • 



T l<n 







u{t)dW? = Y,{f J24 k dB l t ' k )ei> , 
z'eN ^° i,fc 



with (e//)// £ N an orthonormal basis of Each term Jq Yll^ u \' kdB l t ,k are well-defined since it is a 

finite sum of ltd integrals and we have with the Doob inequality 

„t l<n l<n r T 



(45 



Therefore we get, 



(49) E[ sup sup 

i'>i>0t£[0,T] JO 



i?[su P i / Y.AU^f\ 2 \<^L \ E H 

*6[°> T ] J ° Lk Lk J ° 



! }ds. 



u(t)dW t n+i ' 



^ 4 E E E(/ E[(<k) 2 ]ds)\e lf \l_ 

/'CM l—m-i-i ha A, ■'O 



u(t)dw t n+i ll. 



since 



E(/ T ^[(<*)>)MI_ 

i'eN ^° 



Z'gN Z=n+i fceA; 
n+i'-l 

^ ( E E i^Mf_ 

i=n+i fcsA; 
E[|u(*)M, fc )| 2 ]<fe. 



S[|«(s)| 2 ]ds ; 



We also have |V>n,fc|F_ s < \*Pn,k\H- s , and then 

n+i'-l n+i'-l 

E Ei^Mf- s < E ^ 



n+i',s* , 



l=n+i k£Ai 



l=n+i kdAi 



Hence, u(i)dW t n is a Cauchy sequence in C([0, T], -F_ s , |-|oo)- 

The next property is the application of the previous Doob inequality f|49[) when a is bounded. 
Proposition 17. Assume that a € Lt *s bounded by \ <t|oo then wc ho,ve 7 

f ft n 2 

(50) 



i£[ sup 

te[o,T] Vo 



l^a( S )(dW: +l - dW?)\ } < 4\a\lT(C n+l , St - C n+i ,, fl .) . 
6. Solutions to the SDE on P x Q 



Recall that P = P_ s and Q = F s . Let £ = P x Q be the phase space equipped with the product 
Hilbert structure. Considering the injection i : P_ s — > E defined by w t— > (w, 0) and identifying W with 
ioW and W n with i o W n , we can assume that W and the projections W n are C(R, £')-valued. Now, for 
any n > 0, we introduce the finite-dimensional subspace £7 n = H n x ff n C S where H n is given by (|37p . 
We denote also = U n >o-E'n which defines a dense subspace of E. The space E n is finite-dimensional 
and the restriction of the Hamiltonian H on E n is well defined. Moreover, if the kernel K(a, b) is C 2 on 



22 FRANgOIS-XAVIER VIALARD 

each variable, then H(x) = H(p,q) is C 2 in the variable x G E n . We can define the C 1 function / on E n 

as 

(51) x ' y f(x) = (-d q H(x),d p H(x)) T G E n , x e E n . 

Let a : Eoq — > Ie be a Lipschitz map on any ball of and let (X n )o<t< r be the pathwise continuous 
solution of the SDE 

(52) dY t = f(Y t )dt + a(Y t )dW t n , Y = x n 
defined until explosion time T n . We need to consider the following hypothesis. 

HO: The space V can be continuously embedded in C™ +1 (]R a! , M d ) ie there exists C > such that 

Mm+i,oo < C\v\v for any v G V. 
HO': The trace of the operator induced by on H n by d 2 H(Xg) can be controlled as 

(53) tr(a T k(Q n ,Q n )a) < c. 

Note that if HO holds, then for any b, b' G R d , K(., b)b' G V and K is C m+1 in each variable. Moreover, 
the second hypothesis HO' will be verified (in lemma [1]) for a a Lipschitz mapping in L{F S ) with the 
additional assumption that for every X G E, o~x{L l ) C L 1 and the norm of this restriction (with the 
L 1 norm) is bounded uniformly in X. However it can be interesting to keep this hypothesis for slightly 
different models. 



Proposition 18. Under assumption HO, the explosion time of the SDE (|52j) is almost surely infinite ie 
X n is defined for t > a.s. 

Proof. Let R > be a positive real number and rjj = inf{ t > | \X™\ > R } (which is well defined since 
X n exists and is continuous until explosion time). We denote by T n = lim/2_ 5>00 r^, so that on the event 
(t™ < oo) the solution X™ blows up for t — > T n . Using Ito formula for the process H(X™ AT n) we get for 



f^R 

H(X? AtR ) = H{a%) + J {d q H{X")dQ n s + d p H{X")dP r s 



+ \{{a{X^)dW n ) T {dlH(X^)a{X-)dW n ) 

Since we have 

. d q H(X?)dQ? + d p H(X?)dP t n = dH p (X?)a(X?)dW t n 
• from HO', we have that almost surely, for all t 

f {{<j{X™)dW n ) T d 2 p H{X™)<j{X™)dW n ) s < ct. 
Jo 

we get 

H(X& r ») < iJ(xJ) + M MT n + J -cds 
where Mt AT « is a bounded continuous martingale. So that with the hypothesis HO' we have, 

E{H{X^ T n))<H{x n Q ) + \c{t^l). 

In particular, E(f Q R H{X™)ds) < tH{x%) + § t 2 < oo and using Fatou Lemma 

(54) E{ / H(X^)ds) < tH(x%) + - 1 2 < oo 
so that almost surely 

r tAr R 

(55) / H{X™)ds < oo . 

JO 

Now, for x = (p,q) G E n , we consider 

[ K(z,q(z'))p(z')dz' eV 
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for which 

(56) \\vx\v = \l p(z) T K(q(z),q(z'))p(z')dzdz' = H(x) . 

" J- m ^ J- m 

From (|55p and (|56p . we can define by pathwise integration a continuous random process 

<& n = m <t<rz 

solution of the flow equation, 

(57) §i*? = vx?(*?). 

Assuming a continuous embedding V C m+1 (R rf , M. d ), ^"at^ * s a l mos t surely a C m+1 diffeomorphism 
and there exists a constant D such that almost surely 

r tAr R 

(58) | m+1>00 < Cexp(CVt( / H(Xg)ds) 1 ^ 2 ) . 

R Jo 

In the sequel, we denote by C a generic constant non depending on n, t and R possibly changing from line 
to line. Thus, since Q™ AT n = n(<?o) an d su P n >o kol^ ^ °°> we f rom Theorem [JJ and proposition 
[TBI that, uniformly in n, we have almost surely (for maybe a different but still universal constant C, see 
above) 

rtAT n 

(59) Kf = limsup |Q" Ar n|j? s < Cexp(CVt( / (A^cis) 1 / 2 ) < +oo . 

In particular, Qf does not blow up for t — > r n on T n < oo. Therefore it is sufficient to show that does 
not blow up as well to get by contradiction that r = oo almost surely. 

As from the continuous embedding on V in C m+1 , |dfa;|m,oo < CI^iIvj we S e t from proposition [TBI 
|d«x tAr n (Q™at ?i )I-P s — ^^^(^tAr")! 1 ^ 2 -^™ an d using the continuity of the product in F s (i.e. there exists 
M > such that \ ff'\F s < M\f\ Fg \f'\ Fg for any /, /' G F s ) we obtain for any 5q G F s 

Therefore, 



(60) / (d^nCQ^rnWJ'iTArsW.W)^^ 

= [ (P^ TR (z),dv XtAT n(Q? ATn (z))Sq(z)) Rd dz <C\H(X tAT n)\^K^ AT n\ F _ s \dq\ Fs 

and 

\d q H(X& T »)\ F _. < C\H(X tAT n)\V 2 K?\P? AT n\ F _ s 

since d q H(X? AT n) = dv XtAT n (QtAr*)* P?at»- We deduce tnat 

\P?At%\F- s < bob-, + CK tj ff (^Ar«) 1/2 |P s n Ar S lF_ s + I ^ ^X")^!^ 
and from Gronwall's Lemma 

(61) l^Jr-. < f Hfc. + sup | ^)dWn,J e^^J""* . 

" y u<tAT% Jo J 

Since from the Doob inequality we have for = inf i<j< m Sj 

/■uArg 

(62) P( sup 1/ a(JC?)dPClLj < 4klL<C_ lia . 

u<tArg JO 

with a right-hand side independent of R, we deduce that almost surely 

/■uArjj /"uATjj 

(63) sup | / a(^)dlC| F _ B < sup | / r(*£)dW?ltf_. < +oo . 

u<tAr JO u<tAr JO 
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and from (|55p . ()59[) and (|63p . we get almost surely 



sup |P t ™ T n|^_ s < +00 and r n > t . 

□ 



Proposition 19. Let f be defined by (|5ip and assume that H0-H'l-H2 hold. Then for any n > i/iere 
exists a unique strong solution X n = (P n , Q n ) : ft, — > C(1R+, E) to 

(64) X? = X% + f f(X?)ds + f a(*?)dW?, X™ = Xq G i? n 

JO ■/ 

and a random solution X = (P, Q) : f2 — )■ C(R+, -E) to 

(65) X t = X + f f(X s )ds + / a(X s )dW s , X = x G E 

Jo Jo 

such that almost surely: 

sup \X t -X?\ -+0. 

0<t<T 

Proof. From proposition [TUJ we know the existence of the finite-dimensional approximation solution 
{X™)t>o for t > 0. Moreover, we know from proposition ED the existence of maximal solution (Xt)o<t< r 
of the SDE (|65l) (Xj)o<t< T up to a possibly finite explosion stopping time r. Moreover, for any T > and 
any r > we have almost surely 

rt/\T r rt/\T r 

(66) suplX^ -X tATr \ -> and sup | / a(X?)dW? - a{X s )dW s \ -> 

t<T r 0<t<T Jo JO 

where r r = inf{i > | > r}. What we need to prove is that there is no explosion ie P(r < +00) = 
or equivalently, r T . — > +00 almost surely. We start from inequality (|54|) in the proof of proposition (|18|) . 
Using the uniform convergence (|66p and Fatou's lemma, we get 

ptAT 

(67) E{ / H(X s )ds) < tH(x ) + -t 2 < 00 . 

Jo 4 

Similarly starting from (f59|) . we get that 

ft/\T 

(68) tf t = limsup \QtAr R \F s < Cexp(CVt( / H(X s )ds) 1/2 ) < +00 . 
Moreover, from (|6ip . we get for n — >■ 00, 

(69) |P iArr | F _ s < ( | Po |f_ s + sup I / r a(X s )dW s | F _ s ) e M^v7 (/ r^(x sATr ) ds)1 / 2 

\ U<tAr r JO J 

Since as in (|62|) Doob inequality gives for s* = infi<j< m s. 



ruAT r 

E{ sup 1/ a(Jf s )dW s ||_J < 4|a|^C_ 1 „ 

U<tAT r JO 



there exists a random constant ^ > independent of r such that almost surely 

|PtAr r |F_ s < A t . 

In particular (r < t) C (r r < t) C (maxji^t, A t } > r) and considering the limit r — > 00, we get 
P(r < t) = 0. □ 

6.1. A trace Lemma. We now present a sufficient condition to fulfill the hypothesis HO'. With ad- 
ditional assumptions on the kernel and on the variance term, we give a bound for the bracket of the 
stochastic term of the SDE on finite-dimensional subspaces H n . 

Lemma 1. Let k be a kernel bounded on the diagonal i.e. there exists c > such that b T k(a,a)b < 
c\b\ 2 for any a,b G M. d or equivalently k(a,a) < cldd as a symmetric non-negative bilinear form on M. d . 
We assume also that ^(L 1 ) C L 1 and this restriction is continuous i.e. there exists M > such that 
| f7 (/)|ii — -^I/Il 1 - Then we have, with H the usual Hamiltonian 

[\(o-dW?) T d 2 Ho-dW?) s < c 2 M 2 t. 
Jo 
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Proof. We consider the orthonormal basis (</>n,fc)fce[0,2™- 1 ] r with A n = [0, 2 n_1 ] r to write the Hamiltonian 
as: 

H = Yl PiH9u Qj)Pj » 

with q = Y2ieA Q.i < ^~ nr ^ 2< i ) n,i an d P = Y^ieA P$~ nr ^ ( l > 'n.,i- In this basis, the L 2 scalar product can 
be written as {p,q) = 2~ nr £ ieAn PiQ%- We can write adwn = T / ieA n (T / j & A n a i,j dwj ) 2nr/2( l ) n,i with 
ajj £ L(M d ) and (W J ')j e A„ i.i-d. standard BM with values in R d . Then we have, 

((adW?) T d 2 p Ho-dW?) s = iEE <&Kh)]d« ■ 



2 2r ' 



Thanks to the hypothesis on the kernel, we have for any x, y 6 M d that 



|a T /c(x,y)6| < y a T k(x,x)ayb T k(y,y)b < c 2 \a\\b\ 

and then, 

l a ^/iM<?i><?j) a i,/i| < C 2 |«i,/i||cKj,ft. I- 

Now, we can write with Cauchy Schwarz inequality 

(70) d((adW?) T d 2 HadW?) s < c 2 ^ ]T ( £ \a t , h \) 2 ds < £ cV(^)li. 

fteA„ i£A n h£A n 

< c 2 M 2 { \(/>n,h\h) ds ^ c 2 M 2 ds, 

h£A n 

since for any h £ A n , \<f> n ,h\'Li = 2~ nr . Note that the inequality [70] is a little abusive but it is to be 
understood as an inequality on measures with density w.r.t. the Lebesgue measure. □ 

Remark that we do not need to assume that a : P x Q i— >• is bounded by |<t|oo, o~{H n ) C H n . This 
hypothesis is only required for the existence and uniqueness in all time but not to bound the trace of the 
operator. 

The assumption on the kernel is not restrictive in our range of applications with kernels such as Gaussian 
kernel or Cauchy kernel. However, the assumption on a is much more demanding. However a wide range 
of linear maps can be reached. For instance, the convolution with a smooth function is a continuous 
operator on F s then by duality it gives a continuous operator on F- s - This operator has a continuous 
restriction to L . 

An important point is that this Lemma covers the case where a is the multiplication by an element of F s . 

7. Approximation Lemmas 

Let / : — > E be a function on E^ such that f(E n ) C E n for any n > 0. Let also a : P x Q \— > L(P) 
be a Lipschitz function. Assume that for any n > 0, we have a random variable X n : — > C(M.+ ,E) 
solution of the stochastic integral equation 



(71) = X " + f f(X?)ds + f a(X2)dW?, X " ee x n Q G E n . 

Jo Jo 

HI: The functions / and a are Lipschitz on E^ and can be uniquely extended as Lipschitz functions 

on E. Moreover a is bounded. 
H2: For some a > 1, we have ^n>o n2a \ x o +1 — Xq\ 2 < oo. 

Proposition 20. Let s > 1 be a real number. Under hypothesis (HI — H2), there exists a random 
solution X : Q -> C(R+, E) to 

X t = X + f f{X s )ds + f a(X s )dW s , X = x €E 
Jo Jo 

such that for any T > 0, we have almost surely: 

sup <t<T \Xt ~ X t\ -+0. 

(72) 

su Po <i<T I /o <r(X?)dW? - /„' <7(X fl )dW s | -> . 
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Proof. Let n > be a positive integer and K be an upper bound of the Lipschitz constant for / and a. 
We have 

(73) \Xl l+1 - X\ l \ < - xS\ + K f \X^ +1 - X^ds + |M™ +1 - M?\ 

Jo 

with M" = Jq a(Xg)dWg. Let us consider the last right-hand martingale term. We have 

M™ +1 - M" = / - a{X™))dW™ +l + f <r(A7)d(VF n+1 - . 

J o Vo 

Using the Doob inequality, we get 

(74) E(sup| /^ ( r(^+ 1 )-a(X-))^ +1 |Lj<^Pl r^^r 1 )-^^))^ 41 !^) 

u<t JO M<< JO 

< AC. hSt K 2 E( [ U \X2 +1 - X r s fds) 
Jo 

and with S n>St = C n>s » - C n+1>s „ 

£(sup | / a(X?)d(W n+1 - W n ) s \ 2 F _J < £(sup | / a{X™)d{W n+l - W n ) s \ 2 H _ s ) 

u<t Jo u<t Jo 



(75) 

Thus, for = sup u < t \X£ +1 - X™| 2 , we have 

(76) E(sup\MZ +1 - M™\ 2 ) < 8(K 2 C S [" E(Z?)ds + M^».-.) 

u<t JO 

and using the inequality (a + b + c) 2 < 3(a 2 + 6 2 + c 2 ) and (|73p . we get 

(77) E{Z?) < 3(|a£ +1 - aff| 2 + 8|a|^5 n , a . + K 2 (8C. hSt + 1) f . 

Jo 

Applying Gronwall's Lemma, we get for a sufficiently large constant A 

(78) E(Z?) < A(\x% +1 - x%\ 2 + \o-\l5 n , St )eMAt) 
and from H2 

n>0 s - t n>0 

Borel-Cantelli Lemma gives a.s. sup s<t \X™ +1 — X"| < n~ a for n large enough so that X n converges 
uniformly on any compact interval [0,t] to a C(R+, £')-valued process X. Similarly from (|76j) . f|T8j) and 
H2 we get 

P(snp |M s n+1 - M™| > n~ a ) < ^ n 2a E(sup \M? +1 - M s n | 2 ) < oo 

n>0 s - t n>0 s - t 

and M n converges uniformly on any compact interval [0,t] to a limit C(K+, i?)-valued process M for 
which 



Let us check that 

M-t 

Indeed, since 



X t = x + [ f(X s )ds + M t . 
Jo 

[ a{X s )dW s . 
Jo 



£(sup| f a{X s )dW s - M™| 2 ) < 8(E( f K 2 \X S - X™\ 2 ds) + \a\lC n , St 

u<t Jo Jo 

we get for n -> 0, £(sup u < t | J " <r(X s )dW fl - M™| 2 ) = 0. □ 

We extend now the previous result to locally Lipschitz drift / and diffusion a. 

HI': The functions / and a are Lipschitz on any ball of E^ and can be uniquely extended as locally 
Lipschitz functions on E. 
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Proposition 21. Let s > 1 be a positive real number. Under the hypothesis (Hi' — H2), there exists a 
stopping time r and a continuous adapted process (-Xt)o<t< T with values in E such that 

(1) limsup^ T - \Xt\ = +oo on (r < oo) (t is the explosion time) ; 

(2) for any r > and any T > 0, we have almost surely 



SU P(Kt<T \ X t?\T r - X t/\T, 



su Po <t<T I °( X s)dW? ~ C Tr *(X a )dW 8 \ ->• 



(79) 

1 /o 

where r r = inf{i > | \Xt\ > r}. 
Moreover, for any t > 

rt/\T T rtAr r 

(80) X tATr =x + f{X s )ds + o-(X s )dW s a.s. 

Jo Jo 

Proof. Let i? > r > be two positive real numbers and 

g(x) = max(min(l, R — \x\), 0) 

be a Lipschitz function such that g R {x) = 1 if \x\ < i? and g R {x) = if |x| > JS + 1. We introduce 
also f R = g R f and <7^ = g R o~. From HI' f R and a R are Lipschitz and we get from standard results 
on existence of finite-dimensional SDE a solution X R ' n E C(R+,E n ) of dY t = f R (Y s )ds + o R (Y s )dW™ 
and lo = Xq . From Proposition [20] applied to f R and o~ R , there exists a C(K+, £')-valued process X R 
solution of dY t = f R (Y s )ds + cr R (Y s )cW s and Y = x such that P(sup s < 4 |Jff - ' n \ -> 0) = 1 and 
P(sup s < t \ f° a{X R )dW u - f° a(X R ' n )dW™\ -)■ 0) = 1. Since / B and / (resp. cr^ and a) coincide on 
\x\ < R, we get for any n > that 

A^ ' rt, = X n d n a.s. 

tAr*' n tAr£' n 

where T^ ,n = inf{t > | \X^' n \ > R}- In particular r^ ,n = rjj = inf{t > | \X™\ > R} almost surely 
and for any T > 0, P(sup < t < T \X? AtR - X R rR \ -> 0) = 1 with r R = M{t > | \X t R \ > R} since the 

uniform convergence of X R,n to X R on compact set implies that a.s. rjj > t r for n large enough. As a 
consequence, for two solutions X R and X R for i?' > r, we have s. and the trajectories before 

the common value r R are equal. Let R^ be an increasing sequence converging to +oo and r = lim^oo t R * . 

If X* = ££L *f fc+1 l H fc ^ for * ^ r > the P rocess TOo<t<T verifies (1), (2) and §0}. □ 



8. Applications and numerical simulations 

This section will present a direct application of the SDE we have studied. In this simplest model, we 
suppose a shape to be given with an initial momentum and we model the perturbation term with a white 
noise on the initial shape. Therefore the variance of the noise term is constant in time. 
Let (qo,Po) be respectively the initial shape and the initial momentum of the system. As in the determin- 
istic matching with a sufficiently smoothing attachment term, the momentum is a normal L 2 vector field 
on the shape, it is relevant enough for applications to consider qo £ F s and po £ F~ s . To assume qo £ F s 
means that we chose a parameterization of the shape by T m . We would like our stochastic system to be 
independent of this initial parameterization. Then we need to understand what is the reparameterization 
transformation on the deterministic system and on the white noise. 

Assume that <f> is a diffeomorphism of T m , then we give the correspondence between the solution (pt,qt) 
from initial conditions (po,qo) and (pt,q~t) with the initial position variable qo o <f>. 
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As the trajectory is entirely determined by the vector field v Puqt , the change of variable by (j) gives the 
correspondence: 

qt = qt°4>, 

p t = 3ac((j))p t o 0. 
We will denote by cjf (p) the pull-back of p under <j). 

The stochastic system verifies the same transformation and the pull-back of the cylindrical Brownian 
motion is given by 

B = Jac(» B o <f> . 

We need the following proposition. 

Proposition 22. If B is a cylindrical Brownian motion on L 2 (T n ,v) with v <C n (fj, is the Lebesgue 
measure) then (j)*(B t ) = Jac((j})B t ((/)(s)) is a cylindrical Brownian motion on L 2 (T n , v') with ^ = j^n* ■ 
Moreover if f G I? with f ^ a. e., f B is a cylindrical Brownian motion for the measure -pdv. 

Proof. If (ej)jgN is an orthonormal basis of L 2 (T n , v), then y/ Jac(0)e, o <p is also an orthonormal basis for 
L 2 (T n , v) by a change of variable with <f>. As a result, Jac(^)ej o (j) is an orthonormal basis for L 2 (T n , u') 
with *f = 

The second part of the proposition is also straightforward: if (ej)j 6 N is an orthonormal basis for L 2 (T m , M. d ), 
then (/ej)igM is an orthonormal basis for L 2 (T m , -pdv). □ 

Corollary 1. The random process <ft*(Bt) is equal to \J Jac(<f))Wt with Wt a cylindrical Brownian motion 
on L 2 (T m ,R d ). 

Back to our framework with F s x F- s , we remark that the space F s is not invariant under a change 
of coordinates: let ^ be a diffeomorphism of T n then a priori, if q £ F s then q o (j) may not belong to 
F s . However if q and 4> are sufficiently smooth then T{q) := q o <p belongs to F s . Hence there exist large 
subspaces in F s invariant under this transformation. To go further we could prove that if s < s' then 
T(F s i) C F s . We would have the same result for the dual spaces: T(i ? _ s ) C F_ s i. Furthermore we would 
like to deal with piecewise diffeomorphisms, this is why the formulation of the following proposition is a 
little more general. 

Proposition 23. Let q G F s (T n ,R k ) and : T n I—)- T n be a measurable invertible mapping (i.e. there 
exists (f>~ 1 : T n i— > T n measurable such that <p o = Id a.e.). We assume also that qo £ F s , po eft £ F^ s 

and J := ^ G F s (T n ,M.) such that J > e > a.e. Finally, let B be a cylindrical Brownian motion. If 
{pt,qt) is the solution of the system 



(81) 



| dp t = -d q H(pt, q t ) + edB t 
\dq t = d p H(pt,q t ) , 

(withe a constant parameter) for initial data (po,qo) and for the path of the white noise B then (4>*(pt),Qt° 
(j)) is the solution of the system 



(82) 



I dp t = -d q H(p t , q t ) + EyJ Jac(4>)dB t 
ydq t = d p H(pt,q t ) , 

for initial data ( J(f>* (po), qo ° </0 and for the random process \/~JB, with B a cylindrical Brownian motion. 

The random process can be treated in our framework with the map o : E n i— > L(F S ) given by the 

multiplication with p n (y/j): As J > e we have that x/j G F s by smoothness of the square root outside 0. 
Thus a is a Lipschitz map such that a(H n ) C H n since the projection is Lipschitz and the multiplication 
in F^ s by an element of F s is Lipschitz too. It leads to 

Theorem 2. Under assumption HO, let f G F s and (po,Qo) G F_ s x F s be initial conditions verifying that 
there exists s" < s and s' > s such that qo G F s i and po G F s n . Then random solutions of the following 
system with initial conditions (po,qo) 



(83) 



dp t = -d q H(p t , q t ) + fdB t 
dq t = d p H(pt,q t ) , 
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are defined for all time and there is an almost sure convergence of the approximations ( also defined for all 
time) 



(84) 



\dp? = -d q H(p?,q?) + f n dB t 
\dq? = d p H(p?,q?), 

to the previous random solution with initial conditions (Pq;9o) ^ e projection on E n of (po,qo). 

Proof This is the application of proposition [191 We verify hypothesis HO' and control the trace of the 
operator. Remark that we need to control the Hilbert-Schmidt norm of the operator a T k(q, q)a with a 
the multiplication by an element of F s . This is a consequence of Lemma Q] but we give here a simpler 
proof, since the multiplication is a diagonal operator. We have 

\r\oo<c s \r\ Fs <c s \f\ Fa , 

then we get for any q £ F s , 

0< f f n {s) T k{q{s),q{s))f n {s)ds<Cl\kUf\lyo\{T m ). 
Thus hypothesis HO' is verified. 

From the assumption on the initial conditions, if go £ F s t with s' > s we have 



2 _ V 9 n(s'-s)| n+1 n.|2 . , 

F gl - < q ~%\F S <+00. 



n=0 



Moreover, if po G F s " then 



I™ I 2 — \ ^ nn(s—s") „".|2 ^ i 

n=0 

Hence H2 is verified. □ 
Remark that H2 is not so demanding as proved in this theorem. 

Now we can discuss some basic situations to simulate the stochastic system (|8ip . The preceding result 
will enable us to deal with a wide family of shapes and noises. We first develop the case of curves. 

Proposition 24. Let 1 < s < 2 a real number and f : Si i— >■ R 2 be a piecewise C 2 mapping such that 
\f'\ > e > with e a real positive number. If we denote by a the arc-length parameterization of f then 
there exists a piecewise affine homeomorphism <j) : S\ i— > S\ such that (p 6 F s and a o cj) is in F s . 

Proof. Let us assume that the arc- length parameterization a has p singularities at points x\ < . . . < x n S 
Si. Then, we define <p as the linear interpolation on n dyadic points in Si, d\ < . . . < d n with for images 
respectively x\ < . . . < x n . As <p is piecewise affine it belongs to F s thanks to proposition [6j With the 
same argument we conclude that a o <fr £ F s . □ 

The previous proposition tells us that we can consider our stochastic system on an initial shape with a 
white noise which is white with respect to the arc length. Hereunder are some simulations to illustrate the 
convergence of the landmark simulation and the kind of trajectories generated by this model. The figure 
Fig. [7] presents the convergence of the image of the unit circle under the flow generated by the system 
with an increasing number of landmarks. We chose to illustrate this convergence since in some sense it 
just shows the convergence of the vector fields generated by the stochastic system. 

We may also want to see how the shapes are distributed around the target shape, or to learn something 
about a neighborhood of a shape in this stochastic model. We plotted few simulations of the model for 
the unit circle as initial shape and an initial momentum which is null to see how the neighborhood of the 
circle looks like. In the figure Fig. [8] the red curve is the unit circle and the other curves from green to 
blue are random deformations of the unit circle for 200 landmarks. The kernel size is 0.7 and the standard 
deviation of the noise (normalised with the number of particles) is relatively high at £ = 3. 
The last simulation shows again the convergence of the landmark discretization as in figure Fig. [7] but 
with a structure of noise which is null on the particles qi initially such that p x (Qi) < (i.e. with negative 
abscissa) . It illustrates the locality of the noise and we can remark the size (variance) of the kernel in this 
simulation. In this case the kernel size is smaller at 0.25 and the standard deviation of the noise is 1.5. 

Theorem [2] enables us to deal with a white noise with respect to the induced measure of a manifold 
embedded in M. k . 
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Figure 7. The convergence when increasing the number of landmarks. From 32 landmarks to 512 
landmarks for qo the unit circle and po = 0, the curves from green to blue show the image of the unit circle 
under the flow for the T particles for i £ [5, 9]. The width of the Gaussian kernel is 0.5 and the intensity 
of the noise is e = 1.5. 
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FIGURE 8. 5 simulations of random 

deformations of the circle. FIGURE 9. Local noise. 

Proposition 25. There exists cf) : T2 *— > S2 verifying the assumptions of proposition [2M If Bf is the 
cylindrical Brownian motion for the measure associated with the induced metric of S2 in K 3 , then <j)*{Bt) 
can be written as yj Jac(<fi)dWt with Wt a cylindrical Brownian motion. 

Proof. Consider a dyadic partition of T2 in 6 squares. The radial projection of the cube on the sphere 
gives the desired result. The map <p is given by the mapping of the dyadic partition on the six faces of 
the cube, which is piecewise smooth and the Jacobian is bounded below. Then we have the desired result 
thanks to the corollary [TJ □ 

As said above, following such kind of decomposition we can get a wide range of embedded manifolds 
in the euclidean space. To illustrate the model in 3 dimensions, we give some examples of the stochastic 
shooting between an initial hippocampus^ (the so called part of the brain located in the medial temporal 
lobe) and a target one. The figure Fig. [10] represents the initial hippocampus and the figure Fig. [TT1 shows 
in the same figure 3 simulations (red, green and blue) of the SDE with an initial momentum that solves 
the boundary value problem between the initial hippocampus and a target hippocampus not showed here. 

In the simulations we observed that a statistical study of the stochastic model requires to control 
carefully the invariance of the system with respect to a change of time coordinates and the understanding 
of the relation between the kernel size and the variance term of the model. 

9. Conclusion and open perspectives 

The original motivation of this work was to prove an extension of the stochastic model in the case of 
landmarks to the infinite-dimensional case of shapes. In Section[3]we proved that the solutions of the SDE 
on landmarks are defined for all time by controlling the energy of the system with the help of Ito formula 



data courtesy of G. Gerig (University of Utah) used in [16] from a study on autism disease 
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FIGURE 10. The initial hippocampus 



FIGURE 11. 3 perturbations of the geo- 
desic shooting 



on the Hamiltonian. Hence it gives a stochastic shape evolution model in the case of landmarks. We then 
developed in Subsection 13.11 a strategy to extend the SDE in infinite dimension to a well chosen Hilbert 
space. We discussed in Section [4] an example of such a well chosen Hilbert space by introducing the spaces 
F s in any dimension. As we aimed to prove a convergence of the finite-dimensional case of landmarks 
to the case of shapes, we also gave a presentation of the cylindrical Brownian motion and the related 
Ito integral that really suits our needs. Apart from our particular choice for the spaces F s , we proved in 
Section under general hypothesis (Section [7J) on the finite-dimensional approximation subspaces that 
the solutions of the SDE on these subspaces converge almost surely to the solutions of the SDE in infinite 
dimension. Finally, we dealt with a general variance term to account for a possible reparameterization of 
the shape as detailed in Section [HJ where some simulations in 2D and 3D are showed. 

On the mathematical aspects of this work, we did not explore yet all the possibilities for the structure 
of noise in our framework. At this point an operator a € L(P, P) (with the L 1 condition) seemed to 
be sufficient for practical applications. But for instance we would like to know if the situation where 
the noise is supported by a finite sum of Dirac measures belongs to our framework for a white noise on 
L 2 (T n , fi) with [i the Lebesgue measure. Moreover we guess that our work can be extended to any Radon 
measure on T n instead of the Lebesgue measure, which would extend the structures of the noise that can 
be attained. 

Another mathematical perspective opened with this work is to study stochastic perturbations of the 
EPDiff equation: 



where K is the chosen kernel. However, we face the problem of the definition of the noise on the space of 
momentum which is the dual of the Hilbert space of vector fields V . As a consequence the choice on the 
noise is really broad and we underline that in our case the manifold on which the diffeomorphism group 
acts gives the structure of the noise. 

Our central motivation with these stochastic second-order model is to design growth model on shape 
spaces. Enhancements of this model are at hand at least in two directions: the first one is to incorporate 
a deterministic control variable (absolutely continuous) on the evolution of the momentum to fit in the 
splines framework presented in the introduction section. The other direction is to incorporate in the 
random noise a jump process to account for sudden transformations of the shape. Therefore the enhanced 
model could be written as: 



(85) 



dm + ad* u m dt = adB, 
u = K -km , 



•t ! 



(86) 



dp t = -d q H(p t , q t ) + u t + edB t + dJ t 
dq t = dpH(p t ,q t ) , 
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with Jt for instance a compound Poisson process Jt = ^] i=1 with independent and identically 
distributed random variables on P = F_ s independent of the Poisson process. This jump process gives 
the opportunity to introduce discontinuities in the momentum evolution. 

The parameterization of the noise is a crucial issue, since the main issue in this model is a certain 
redundancy between the kernel and the choice of the noise. Also this parameterization is strongly related 
to the observed data. For instance, if evolutions of surfaces are considered, the corresponding momentums 
are always orthogonal to the current shape. Therefore the noise introduced needs to keep this structure 
unchanged. More generally, the effect of the noise should keep the symmetries of the deterministic 
solutions. 

Last, the role of the time variable is also crucial in the estimation of the time variability of a biological 
organ. That's why we should study stochastic models able to retrieve the information on the speed of 
the evolution. Although the speed is encoded in the stochastic model, the model could be able to learn a 
time reparameterization. It is a first step in the direction of designing a realistic growth model for shapes 
within the framework of large deformation diffeomorphisms and it underlines the efficiency of second-order 
models as good candidates. 

Being aware of some developments for the estimation of the diffusion parameters for second-order models 
in |25] or in |24] . our main research efforts will be focused on consistent statistical schemes to be applied 
on biomedical data. 
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10. Appendix 

Proposition 26. Let (Ej)\<i< 2 be two separable RKHS of real valued functions defined respectively on 
X\ and X 2 ■ Then we have : 

(1) The tensor space E\ ® E 2 is a separable RKHS on X\ x I2. 

(2) If for any i G {1,2}, there exists Mi > such that for any f,f G Ei, ff G E{ and \ ff'\Ei < 
Mi\f\Ei\f'\Ei (we say that Ei is an algebra of functions with continuous product), then the same 
result is true for E\ (g> E 2 . More precisely, for any g, g' G E\ ® E2, we have gg' G E\ ® E2 and 

\gg'\E 1 ®E 2 < M 1 M 2 \g\E 1 ®E 2 \g'\E 1 ®E 2 

Proof. Proof of 1) : If (a n ) n >o and (6 n ) ri >o are Hilbert basis of E\ and Ei, then (a m (g> & n )m,n>o is 
an Hilbert basis for E\ ® E 2 . Now for any [x\,X2] £ Xi x X 2 , there exists a unique continuous map 
°~x 1 .x 2 '■ E\ ® E 2 — > R defined by the values 5 XltX2 (a m <8> b n ) = a m (xi)b n (x 2 ) on the Hilbert basis. Indeed, 
for any finite linear combination g = Y2( m n)el ^m,n a m <8> b n , one has 



^ X] Vn a m( x l) ) b n ) (^2) 

n>0 V m s.t. (m,n)£l 



Since E\ and E 2 are two RKHS, there exist C\(xi) and C 2 {x 2 ) (depending on x\ and x 2 ) such that 
|a(cci ) I < Ci(xi)|a|£i and b(x 2 ) < C 2 {x 2 )\b\E 2 for any a,b £ E\ x E 2 . Therefore, 

\ v xi,x 2 

(g)\ 2 <C 2 (x 2 ) 2 ^2[ X m,na m (xi) 
n>0 s.t. (m,n)el 

^C^fC^f X kn<(Ci(xi)C 2 {x 2 ))\g\ 2 E ^ E2 . 

(ra,n)al 

In particular, we have 

||*Xl,*a|| < 11^! II 11^2 II 

where 5 l x . : Ei — > R such that 8 X .(f) = f(xi) for any / G Ei. 

Note finally that for any g £ E\® E 2 , if S xltX2 (g) = for any (xi,x 2 ) G Ex X E 2 , then g = 0. Indeed, if 
then g = Y.n> A n ®b n where A n = Y.m>o ^m, n a m so that for any (x\,x 2 ) G Xi x X 2 , 
we have Y,n>o A n (xi)b n (x 2 ) = ^(En^^^i)^) = 0. For fixed x\ G Xi, and b = J2 n >o A n(xi)b n , we 
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have b{x 2 ) for any x 2 € X 2 so that 6 = and A n {x\) = for any n > 0. Considering now arbitrary x±, we 
get that Ylrn>o ^m,n a m. = so that \ m ,n = and g = 0. Hereafter, we will denote (without ambiguity) 

g(x 1 ,x 2 ) = S Xl>X2 (g) . 

Proof of 2) : If g N = Eo<m,n>7V V,nOm <8> 6 n and 5^ = Eo<m,n<7V A m,n a m ® &n, then 

(9n9n) = ^2 -^m,nAp i q(a m (8) f n )(a p <8> 6 9 ) . 

0<m,n,p,g<7V 

Since a m a p E £1 and b n b q £ E 2 and 

(flm ® fn)(xi,x 2 )(a p ® 6 ? )(xi,x 2 ) = a m (cci)a p (xi)6 n (a;2)i' ? (a; 2 ) = (a m a p )(a;i)(6 n 6g)(a;2) 

we get (a m ® /„)(a p ® 6 ? ) = (a m a p ) ® (fe„6 g ) and 

\{a m a p ) ® (b n b q )\ El ®E 2 = \a m a p \ E^bnbql e 2 < M X M 2 . 

c.s. 

Hence |ffjvff^|Ei®£ 2 < M X M 2 Y,o< m ,n,p,q<N \^m,nX p J < M 1 M 2 \g\E 1 ®E 3 \g\E 1 ®E2 and the sequence g N g' N 
is bounded in E\ ® E 2 . Since for any weak limit, we have gN k 9N ( x l, x 2) ~^ (gg')( x i, x 2) we get that 
gg' € Ei ® E 2 and by lower semi-continuity of the norm for the weak convergence : 

\gg \e : ®e 2 < MiM 2 \g\E 1 ®E 2 \g'\E 1 ®E 2 ■ 

□ 
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